Papers with Iterative Normalization
Are Girls Neko or Shōjo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings (CLWE) are used to perform multilingual natural language processing tasks. |
| Approach: | They propose a method that transforms monolingual embeddings to make orthogonal alignment easier by simultaneously enforcing that (1) individual word vectors are unit length, and (2) each language’s average vector is zero. |
| Outcome: | The proposed method improves translation accuracy of three CLWE methods, with the largest improvement observed on English-Japanese (2% to 44% test accuracy). |